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ABSTRACT 

Objective: Although the values of soluble mesothelin- 
related peptides (SMRPs), including mesothelin and 
megakaryocyte potentiating factor, in serum and/or 
pleural fluid for diagnosing malignant pleural 
mesothelioma (MPM) have been extensively studied, 
the exact diagnostic accuracy of these SMRPs remains 
controversial. The purpose of the present meta-analysis 
is to update the overall diagnostic accuracy of SMRPs 
in serum and, furthermore, to establish diagnostic 
accuracy of SMRPs in pleural fluid for MPM. 
Design: Systematic review and meta-analysis. 
Methods: A total of 30 articles of diagnostic studies 
were included in the current meta-analysis. Sensitivity, 
specificity and other measures of accuracy of SMRPs 
in serum and pleural fluid for the diagnosis of MPM 
were pooled using random effects models. Summary 
receiver operating characteristic curves were used to 
summarise overall test performance. 
Results: The summary estimates of sensitivity, 
specificity, positive likelihood ratio, negative likelihood 
ratio and diagnostic OR were 0.61, 0.87, 5.71, 0.43 
and 14.43, respectively, for serum and 0.79, 0.85, 
4.78, 0.30 and 19.50, respectively, for pleural fluid. It 
was also found that megakaryocyte potentiating factor 
in serum had a superior diagnostic accuracy compared 
with mesothelin for MPM. 

Conclusions: SMRPs in both serum and pleural fluid 
are helpful markers for diagnosing MPM with similar 
diagnostic accuracy. The negative results of SMRP 
determinations are not sufficient to exclude non-MPM, 
and the positive test results indicate that further 
invasive diagnostic steps might be necessary for the 
diagnosis of MPM. 
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INTRODUCTION 

Malignant pleural mesothelioma (MPM) is a 
highly aggressive almost uniformly fatal 
tumour primarily caused by exposure to 
asbestos. 1 Current therapeutic options for 
MPM are limited and the prognosis is poor. 2 
When patients are treated with standard 
of care chemotherapy, cisplatin and an 
antifolate, median survival is approximately 



Strengths and limitations of this study 



■ The studies included in this meta-analysis were 
methodologically satisfactory and their results 
were consistent and close. 

■ The subjects in the control groups were very 
heterogeneous from one study to another. 

■ Various cut-off points were used for distinguishing 
between malignant pleural mesothelioma and the 
other diseases. 

■ Conference abstracts, letters to the editors, and 
non-English language studies were excluded. 

■ Pathological types of malignant pleural meso- 
thelioma were not specified in some studies. 



1 year. 3 4 Early diagnosis offers the best hope 
for a favourable prognosis; however, the early 
and reliable diagnosis of MPM is extremely 
difficult as only 5% of patients present with 
stage IA disease. 5 6 There is therefore a crit- 
ical need for reliable and non-invasive tools 
that shorten this diagnostic delay. 

Many soluble markers, such as mesothelin 
family proteins, in serum or pleural fluid (PF) 
have been evaluated to facilitate the non- 
invasive diagnostic investigation for MPM.' 1 
Mesothelin is a 40 kDa cell surface glycopro- 
tein that is highly expressed in MPM, pancre- 
atic cancers, ovarian cancers and some other 
cancers. It is synthesised as a precursor 69 kDa 
protein and forms two proteins, the 
membrane-bound mesothelin and a soluble 
31 kD N-terminal fraction, megakaryocyte 
potentiating factor (MPF), also denominated 
'N-ERC/mesothelin'. 7 Although mesothelin is 
bound to the cell membrane, a circulating 
form termed 'soluble mesothelin' has been 
reported to be related to abnormal splicing 
events leading to synthesis of a secreted 
protein and to an enzymatic cleavage from 
membrane-bound mesothelin. 8 

It has been well documented that soluble 
mesothelin-related peptides (SMRPs) , including 
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both soluble mesothelin and MPF, have been found in 
human serum and PR 9 0 The diagnostic accuracy of 
SMRP detections for MPM has been extensively studied, 
but the exact role of these detections needs to be eluci- 
dated. In 2010 we performed and published a first 
meta-analysis reporting the overall diagnostic accuracy of 
serum SMRPs for diagnosing MPM, and our results 
showed that serum SMRP determinations could play a 
role in the diagnosis of MPM. More recently, Hollevoet 
et al 12 performed an individual patient data meta-analysis 
to evaluate serum SMRP levels for diagnosing MPM, and 
found that a positive test result at a high specificity thresh- 
old is a strong incentive to urge further diagnostic steps; 
however, the poor sensitivity of SMRPs limits its 
added value to early diagnosis of MPM. Since that time, 
many additional clinical studies determining the concen- 
trations of SMRPs in serum and PF have been reported. 
We therefore performed the present meta-analysis to 
update the overall diagnostic accuracy of serum SMRPs 
and, furthermore, to establish the accuracy of PR SMRPs 
for diagnosing MPM. 

METHODS 

Search strategy and study selection 

MRDLINR (PubMed database) and RMBASR were 
searched for suitable studies up to 28 November 2013; 
no early date limit was applied. Search keywords 
included 'soluble mesothelin-related peptides/ SMRP', 
'mesothelin', 'megakaryocyte potentiating factor/MPP' 
and 'mesothelioma'. Articles were also identified by 
use of the related articles function in PubMed. 
References of articles identified were further searched 
manually. Although no language restrictions were 
imposed initially, for the full-text review and final 
analysis our resources only permitted review of Rnglish 
articles. Conference abstracts and letters to journal 
editors were excluded because of the limited data 
presented in them. 

A study was included in the meta-analysis when it pro- 
vided SMRP values in serum and/or PR for both sensitiv- 
ity and specificity of the diagnosis of MPM. Studies 
including at least 10 specimens were selected to be 
included in the meta-analysis, since very small studies 
may be vulnerable to selection bias. Publications with 
evidence of possible overlap of patients with other 
studies were discussed by AC, X-GJ and KZ and only the 
best quality study was used. Two reviewers (Z-HT and 
H-ZS) independently judged study eligibility while 
screening the citations. Disagreements were resolved by 
consensus. 

Data extraction and quality assessment 

The final set of Rnglish articles was assessed independ- 
ently by two reviewers (AC and X-GJ). Data retrieved 
from the reports included author, publication year, 
study characteristics, participant characteristics, diagnos- 
tic methods, sensitivity and specificity data, cut-off 



value and methodological quality. All eligible studies 
were assessed for methodological quality using guide- 
lines published by the Standards for Reporting 
Diagnostic Accuracy (STARD, maximum score 25) ini- 
tiative 13 (ie, guidelines that aim to improve the quality 
of reporting in diagnostic studies) and the Quality 
Assessment for Studies of Diagnostic Accuracy 
(QUADAS, maximum score 14) tool 14 (ie, appraisal by 
use of empirical evidence, expert opinion and formal 
consensus to assess the quality of primary studies of 
diagnostic accuracy). 

Statistical analyses 

Standard methods recommended for meta-analyses of 
diagnostic test evaluations were used. Analyses were 
performed using two statistical software programs (Stata 
V.9; Stata Corporation; College Station, Texas, USA; and 
Meta-DiSc for Windows; XI Cochrane Colloquium; 
Barcelona, Spain). We computed the following measures 
of test accuracy for each study: sensitivity, specificity, posi- 
tive likelihood ratio (PLR), negative likelihood ratio 
(NLR) and diagnostic OR (DOR) . 

The analyses were based on summary receiver operat- 
ing characteristic (SROC) curves. 15 16 The sensitivity and 
specificity for the single test threshold identified for 
each study were used to plot an SROC curve. 16 17 
A random effects model was used to calculate the 
average sensitivity, specificity and other measures across 
studies 18 19 and % 2 and Pisher exact tests were used to 
detect statistically significant heterogeneity. Since publi- 
cation bias is of concern for meta-analyses of diagnostic 
studies, we tested for the potential presence of this bias 
using funnel plots and the Rgger test. 

RESULTS 
Studies included 

After independent review, 62 publications determining 
concentrations of human SMRPs in serum and/or PR 
were considered to be eligible for inclusion in the 
meta-analysis. Of these publications, 32 were excluded 
(see online supplementary appendix 1), leaving 30 pub- 
lications available for analysis of diagnostic accuracy of 
SMRPs. 21-50 Rleven publications from 12 studies 21-31 
were included in our previous meta-analysis 11 and an 
additional 19 publications from 28 studies 32-50 were 
added in the current meta-analysis. 

Multiple RLISA kits were available for determining SMRP 
concentrations. Mesomark, which has been approved by 
the US Pood and Drug Administration, was used to deter- 
mine mesothelin in most studies and other mesothelin 
RLISA kits were used in the other four studies. 21 30 31 34 
Serum mesothelin concentrations were determined in 23 
studies (22 articles) 21 23-31 33 35 37-40 42 44 46 47 49 50 and 
serum MPP concentrations were determined in five 
studies 22 30 32 3 46 (table 1). In the study by Scherpereel 
et al, 2 * the authors compared serum SMRP concentrations 
in patients with MPM with those in patients exposed to 
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Table 1 Study summary of SMRPs in serum 











Test results 






Quality scores 


Qti irlw 


ouujecib, n 


CIWIRPc 


Pi it.nff 


TP 


FP 


FN 
PIN 


TM 
1 IN 


STARD 


QUI 


Robinson ef aP A 


272 


Mesothelin 


0.218 OD 


37 


10 


7 


218 


16 


11 


Onda ef aP 2 


126 


MPF 


0.034 OD 


51 


0 


5 


70 


11 


9 


Scherpereel et aP 3 


83 


Mesothelin 


0.93 nmol/L 


48 


4 


12 


19 


14 


10 


Scherpereel ef aP 3 
Beyer ef aP 4 


90 


Mesothelin 


1 .85 nmol/L 


35 


8 


25 


22 


14 


10 


1086 


Mesothelin 


1 .5 nmol/L 


46 


66 


42 


932 


16 


12 


Creaney et aP 5 


233 


Mesothelin 


2.5 nmol/L 


56 


2 


61 


114 


13 


11 


Cristaudo et aP 6 


714 


Mesothelin 


1 .0 nmol/L 


73 


149 


34 


458 


14 


9 


Di Serio et aP 7 


116 


Mesothelin 


1 .5 nmol/L 


16 


7 


8 


85 


14 


12 


Amati et aP B 


170 


Mesothelin 


1 .9 nmol/L 


16 


15 


6 


133 


12 


9 


Shiomi etaP 9 


293 


MPF 


5.6 ng/mL 


28 


17 


11 


237 


20 


13 


Iwahori ef aP° 


156 


MPF 


19.1 ng/mL 


20 


14 


7 


115 


14 


11 


Iwahori ef aP° 


156 


Mesothelin 


123.7 ng/mL 


11 


8 


16 


121 


14 


11 


van den Heuvel ef a/ 31 


229 


Mesothelin 


1 .3 nmol/L 


44 


22 


29 


134 


17 


12 


Creaney ef a/ 32 


107 


MPF 


1.0 ng/mL 


22 


2 


44 


39 


13 


11 


Schneider ef a/ 33 


343 


Mesothelin 


1 .35 nmol/L 


68 


37 


61 


177 


15 


10 


Portal ef aP 5 


362 


Mesothelin 


0.55 nmol/L 


26 


91 


10 


235 


15 


11 


Hollevoet ef aP 1 


507 


Mesothelin 


1 .89 nmol/L 


56 


25 


29 


397 


20 


11 


Hollevoet ef aP 1 


507 


MPF 


13.46 ng/mL 


58 


13 


27 


409 


20 


11 


Creaney ef aP 8 


155 


Mesothelin 


1 .6 nmol/L 


44 


4 


22 


85 


13 


11 


Cristaudo ef a/ 39 


235 


Mesothelin 


1 .0 nmol/L 


19 


41 


12 


163 


16 


10 


Dipalma ef aP° 


354 


Mesothelin 


1 .2 nmol/L 


22 


66 


14 


252 


15 


10 


Ashour ef aP 2 


123 


Mesothelin 


0.55 nmol/L 


30 


34 


8 


51 


13 


9 


Amany ef aP 4 


40 


Mesothelin 


3.3 nmol/L 


19 


1 


1 


19 


12 


9 


Creaney ef aP 6 


121 


Mesothelin 


2.4 nmol/L 


40 


3 


26 


52 


13 


11 


Creaney ef aP 6 


121 


MPF 


33.2 ng/mL 


34 


3 


32 


52 


13 


11 


Ferro ef aP 1 


102 


Mesothelin 


1 .08 nmol/L 


20 


9 


23 


50 


14 


9 


Hooper ef aP 9 


203 


Mesothelin 


1 .5 nmol/L 


16 


62 


11 


114 


15 


12 


Bayram ef aP° 


546 


Mesothelin 


1 .63 nmol/L 


14 


89 


10 


433 


13 


10 



FN, false negative; FP, false positive; MPF, megakaryocyte potentiating factor; OD, optical 
of Diagnostic Accuracy; SMRP, soluble mesothelin-related peptide; STARD, Standards for 
TP, true positive. 



density; QUADAS, Quality Assessment for Studies 
Reporting Diagnostic Accuracy; TN, true negative; 



asbestos with benign pleural lesions and in patients with were determined in 11 articles from 12 studies (mesothelin 

pleural metastasis of carcinomas separately using two differ- in 11 and MPF in 1) (table 2). 23 34 3 41-4 49 

ent cut-off values; we therefore treated these research data The clinical characteristics of the studies along with the 

as two independent studies. SMRP concentrations in PF STARD and QUADAS scores are shown in tables 1 and 2. 



Table 2 Study summary of SMRPs in pleural fluids 



Study 


Patients, n 


SMRPs 


Cut-off 


Test results 
TP FP 


FN 


TN 


Quality scores 
STARD QUADAS 


Scherperel ef aP 3 


92 


Mesothelin 


10.4 nmol/L 


33 


15 


10 


34 


14 


10 


Davies ef a/ 34 


166 


Mesothelin 


20.0 nmol/L 


17 


14 


7 


128 


14 




Fujimoto ef aP 6 


96 


Mesothelin 


8.0 nmol/L 


16 


23 


7 


50 


16 




Yamada ef a/ 41 


98 


Mesothelin 


10.0 nmol/L 


36 


9 


9 


44 


16 




Ashour ef aP 2 


74 


Mesothelin 


3.0 nmol/L 


19 


9 


7 


39 


13 




Blanquart ef a/ 43 


101 


Mesothelin 


24.05 nmol/L 


61 


14 


0 


26 


12 


i 


Amany ef aP 4 


40 


Mesothelin 


3.5 nmol/L 


19 


2 


1 


18 


12 




Canessa ef aP 5 


275 


Mesothelin 


9.3 nmol/L 


38 


27 


14 


196 


16 




Creaney ef aP 6 


98 


Mesothelin 


20.0 nmol/L 


30 


3 


13 


52 


13 




Creaney ef aP 6 


98 


MPF 


600.0 ng/mL 


35 


3 


6 


52 


13 




Filiberti ef aP a 


177 


Mesothelin 


12.0 nmol/L 


42 


17 


15 


103 


14 


12 


Hooper ef aP 9 


193 


Mesothelin 


20.0 nmol/L 


18 


21 


7 


147 


15 


12 



FN, false negative; FP, false positive; MPF, megakaryocyte potentiating factor; QUADAS, Quality Assessment for 
Accuracy; SMRP, soluble mesothelin-related peptide; STARD, Standards for Reporting Diagnostic Accuracy; TN 
positive. 



Studies of Diagnostic 
true negative; TP, true 
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1.0 1.5 0.0 0.5 

Standard error of log DOR 

Figure 1 Funnel graphs for the assessment of potential publication bias in soluble mesothelin family proteins in (A) serum and 
(B) pleural fluid for diagnosing malignant pleural mesothelioma. The funnel graph plots the log of the diagnostic OR (DOR) 
against the SE of the log of the DOR (an indicator of sample size). Each solid circle represents each study in the meta-analysis. 
The line in the centre indicates the summary DOR. 



Study characteristics 

On review, the studies showed large differences in the 
number of participants, clinical characteristics (espe- 
cially histological subtypes of MPM and type of control 
groups) and reported diagnostic cut-off values of SMRPs 
(see online supplementary appendix 2). For serum 
SMRP studies, the average sample size was 265 (range 
40-1086) and the subjects included 1562 patients with 
MPM and 5988 non-MPM. For PF SMRP studies, the 
average sample size was 126 (range 40-275) and the sub- 
jects included 460 patients with MPM and 1046 
non-MPM. 

In 21 publications the diagnosis of MPM was com- 
pletely based on pathological findings in pleural biop- 
sies, with or without positive cytological results while, in 
the remaining nine publications, some patients with 
MPM were diagnosed based only on the cytological 
findings. The quality of the study design and reporting 
of diagnostic accuracy of most studies were generally 
good since 26 of 30 publications had higher STARD 
scores (>13) and 21 studies had higher QUAD AS scores 
(>10). 

Publication bias 

The funnel plots for publication bias showed asymmetry 
for serum SMRP studies (figure 1A) and evaluation of 
publication bias showed that Egger tests were significant 
for serum SMRPs (p=0.038). The funnel plots for publi- 
cation bias also showed asymmetry for PF SMRP studies 
(figure IB) and Egger tests showed that this was signifi- 
cant for PF SMRPs ( p=0.035) . These results indicated a 
potential for publication bias for both serum and PF 
SMRP studies. 

Diagnostic accuracy 

Figure 2A shows a forest plot of sensitivity and specificity 
for 28 serum SMRP studies in the diagnosis of MPM. 
The sensitivity ranged from 0.33 to 0.95 (pooled 0.61, 
95% CI 0.58 to 0.63) while specificity ranged from 0.60 



to 1.00 (pooled 0.87, 95% CI 0.86 to 0.88). It was also 
noted that PLR was 5.71 (95% CI 4.28 to 7.62) , NLR was 
0.43 (95% CI 0.38 to 0.50) and DOR was 14.43 (95% CI 
9.98 to 20.87). % 2 values of sensitivity, specificity, PLR, 
NLR and DOR were 153.68, 460.32, 272.50, 143.64 and 
142.07, respectively (all p<0.001), indicating a significant 
heterogeneity between studies. 

Figure 2B shows a forest plot of sensitivity and specifi- 
city for 12 PF SMRP studies in the diagnosis of MPM. 
The sensitivity ranged from 0.70 to 1.00 (pooled 0.79, 
95% CI 0.75 to 0.83) while specificity ranged from 0.65 
to 0.95 (pooled 0.85, 95% CI 0.83 to 0.87). We also 
noted that PLR was 4.78 (95% CI 3.52 to 6.50) , NLR was 
0.30 (95% CI 0.24 to 0.36) and DOR was 19.50 (95% CI 
12.14 to 31.33). % 2 values of sensitivity, specificity, PLR, 
NLR and DOR were 41.33 (p<0.001), 46.78 (p<0.001), 
38.64 (p<0.001), 14.53 (p=0.205) and 23.49 (p=0.015), 
respectively, indicating some heterogeneity between 
studies. 

The graphs of SROC curves for SMRP determinations 
showing sensitivity versus 1 — specificity from individual 
studies are shown in figure 3. The SROC curve for 
serum SMRPs was not positioned near the desirable 
upper left corner of the curve and the maximum joint 
sensitivity and specificity was 0.741 (SEM 0.029; 
figure 3A) while the area under the curve (AUG) was 
0.806 (SEM 0.032). The maximum joint sensitivity and 
specificity of PF SMRP was 0.820 (SEM 0.022) while the 
AUC was 0.890 (SEM 0.021; figure 3B). 

Thus, in total, the diagnostic performance of SMRPs 
in serum and PF was similar. 

Subgroup analysis 

We first analysed the diagnostic values of serum 
mesothelin and MPF separately and the results are pre- 
sented in table 3. Based on the comparisons of sensitiv- 
ity, specificity, PLR, NLR, DOR and AUC, the diagnostic 
performance of serum MPF was superior to that of 
serum mesothelin. 
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0.6 0.4 
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Figure 2 Forest plots of estimates of sensitivity and specificity for soluble mesothelin family proteins in (A) serum and (B) 
pleural fluid for diagnosing malignant pleural mesothelioma. The point estimates of sensitivity and specificity from each study are 
shown as solid circles. Error bars are 95% CIs. Numbers indicate the reference numbers of studies cited in the reference list. 



Data from six studies ' were available for 

comparing the diagnostic accuracy of serum SMRPs in 
differentiating MPM from healthy control subjects, 
nine studies 21 23 24 26 30 31 33 45 47 were available for dif- 
ferentiating MPM from other malignancies and eight 
studies 21 23-25 28 30 33 40 were available for differentiating 
MPM from asbestos-exposed subjects. As shown in table 4, 
the values of sensitivity, specificity, PLR, NLR, DOR and 
AUG of SMRPs for discriminating between patients with 
MPM and healthy control subjects were quite 



acceptable, and were better than those for discriminat- 
ing between patients with MPM and those with other 
cancers or asbestos-exposed people. By using serum 
SMRPs, it was more difficult to differentiate MPM from 
other cancers than from healthy controls or 
asbestos-exposed people. 

Six studies 23 34 36 41 42 48 provided the required data 
for comparing the diagnostic accuracy of PF mesothelin 
in differentiating MPM from other cancers and four 
studies 35 41 42 48 provided data for differentiating MPM 
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Figure 3 Summary receiver operating characteristic (SROC) curves with 95% CIs for soluble mesothelin family proteins in (A) 
serum and (B) pleural fluid for diagnosing malignant pleural mesothelioma. Each solid circle represents each study in the 
meta-analysis. The size of each study is indicated by the size of the solid circle. The regression SROC curves summarise the 
overall diagnostic accuracy. 



from benign pleural effusions (table 5). In total, the 
diagnostic accuracy of PF SMRP in differentiating MPM 
from other cancers was very similar to that of differenti- 
ating between MPM and benign pleural effusions. 

DISCUSSION 

The diagnosis of MPM is always challenging because (1) 
MPM may appear in patients up to 30-40 years after 
exposure to asbestos; (2) the clinical and imaging signs 
of MPM are non-specific; and (3) a definitive diagnosis, 
which relies on histology, can sometimes be very difficult 
to achieve, even with the use of immunohistochemistry. 5 
To date, no single marker or panel of soluble biomar- 
kers is available for a clear diagnosis of MPM. 51 52 

In the present meta-analysis our results indicated that 
the pooled sensitivity of serum and PF SMRPs was 0.61 
and 0.79, respectively, and their specificity was 0.87 and 



0.85, respectively. These data indicated that the sensitiv- 
ity and specificity of SMRPs in serum and PF were not as 
high as expected. SMRPs might be helpful in confirming 
(ruling in) MPM if the results are higher than the 
cut-off values. Thus, positive SMRP test results suggested 
that invasive diagnostic steps such as medical thoraco- 
scopy might be necessary. On the other hand, the low 
sensitivity will not allow exclusion of non-MM patients 
even if the patients have mesothelin concentrations 
lower than the cut-off value. The associated poor sensi- 
tivity of SMRPs therefore clearly limits their added value 
to the diagnosis of MPM. 

As previously described, 11 SROC curves present a 
global summary of test performance and show the trade- 
off between sensitivity and specificity while DOR is a 
single indicator of test accuracy that combines the data 
from sensitivity and specificity into a single number. The 
results of our analyses based on SROC curves showed 



Table 3 Comparison of diagnostic accuracy of mesothelin and megakaryocyte potentiating factor in serum 

Mesothelin Megakaryocyte potentiating factor 

Studies (reference numbers) 21 ■ 23 " 28 ' 30 ' 31 , 33 ' 35 ' S7 ^°- 42 ' 44 ' 46 , 47 ■ 49 - 50 22, 29, 30, 32, 37, 46 

Sensitivity (95% CI) 0.62 (0.59 to 0.65) 0.62 (0.56 to 0.67) 

Heterogeneity* (p value) 70.20 (<0.001) 53.08 (<0.001) 

Specificity (95% CI) 0.85 (0.84 to 0.86) 0.96 (0.94 to 0.97) 

Heterogeneity (p value) 352.24 (<0.001) 17.60(0.001) 

PLR (95% CI) 4.78 (3.59 to 6.36) 1 2.39 (5.53 to 27.74) 

Heterogeneity (p value) 185.80 (<0.001) 14.42 (0.006) 

NLR(95%CI) 0.45 (0.40 to 0.51) 0.34 (0.19 to 0.63) 

Heterogeneity (p value) 50.65 (<0.001) 67.07 (<0.001) 

DOR (95% CI) 11.84 (8.12 to 17.27) 36.08 (12.91 to 100.85) 

Heterogeneity (p value) 95.80 (<0.001) 13.40(0.009) 

AUC (SEM) 0.785 (0.033) 0.941 (0.094) 

*Q value. 

AUC, area under curve; DOR, diagnostic OR; NLR, negative likelihood ratio; PLR, positive likelihood ratio. 
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Table 4 Comparisons of diagnostic accuracy of SMRPs in serum for differentiating MPM from different control 
subpopulations 




MPM vs healthy 
controls 


MPM vs other cancers 


MPM vs benign 
asbestos-related diseases 


Studies (reference numbers) 
Sensitivity (95% CI) 
Heterogeneity* (p value) 
Specificity (95% CI) 
Heterogeneity (p value) 
PLR (95% CI) 
Heterogeneity (p value) 
NLR (95% CI) 
Heterogeneity (p value) 
DOR (95% CI) 
Heterogeneity (p) 
AUC (SEM) 


21, 22, 24, 28, 30, 31 

0.66 (0.61 to 0.71) 
42.46 (<0.001) 

0.97 (0.96 to 0.98) 
4D./U v<u.uin ) 
24.07 (4.03 to 143.68) 
48.35 (<0.001) 

0.33 (0.22 to 0.50) 
32.11 (<0.001) 
69.27(15.67 to 306.21) 
20.80 (0.001) 
0.870 (0.120) 


21, 23, 24, 26, 30, 31, 33, 45, 47 

0.60 (0.56 to 0.64) 
31.33 (<0.001) 
0.81 (0.78 to 0.83) 

co en / nrn \ 
o^.oy (<U.UU I ) 

2.81 (2.11 to 3.73) 
26.73 (0.001) 

0.52 (0.43 to 0.63) 
25.45 (0.001) 

5.62 (3.67 to 8.59) 
22.70 (0.004) 
0.734 (0.055) 


21, 23, 24, 25, 28, 30, 33, 40 

0.58 (0.54 to 0.62) 
39.91 (<0.001) 
0.89 (0.86 to 0.91) 

on a q / ^n nni \ 
03.40 ^<U.UU1 ) 

6.65 (3.69 to 12.00) 
25.91 (0.001) 

0.44 (0.36 to 0.55) 
24.89 (0.001) 
18.03 (8.90 to 36.52) 
19.16 (0.008) 
0.845 (0.057) 


*Q value. 

AUC, area under curve; DOR, diagnostic OR; MPM, malignant pleural mesothelioma; NLR, negative likelihood ratio; PLR, positive likelihood 
ratio; SMRP, soluble mesothelin-related peptide. 



that the maximum joint sensitivity and specificity of 
serum and PF SMRPs were 0.741 and 0.820, respectively, 
while their AUCs were 0.806 and 0.890, respectively, indi- 
cating that the level of overall accuracy was not as high 
as expected. We also found that the pooled DORs of 
serum and PF SMRPs were 14.43, and 19.50, respectively, 
indicating that SMRPs seemed to be helpful in the diag- 
nosis of MPM but they were not perfect. 

Since SROC curves and DOR are not easy to interpret 
and use in clinical practice, and since PLR and NLR are 
considered more clinically meaningful, 53 54 we further 
presented both PLR and NLR as our measures of diag- 
nostic accuracy. If a value is >10 or <0.1, PLR or NLR 
generates large and often conclusive shifts from pre-test 
to post-test probability (indicating high accuracy). 55 
A PLR value of 5.71 with serum SMRPs suggests that 
patients with MPM have a nearly sixfold higher chance 



of being SMRP-positive compared with patients without 
MPM, and this was not high enough for the clinical 
purpose. On the other hand, the NLR value of serum 
SMRPs was found to be 0.43. If serum SMRP results 
were negative, the probability that the patient has MPM 
is 43%, which is not low enough to rule out MPM. Very 
similar results were found with PF SMRPs. 

Although both mesothelin and MPF belong to 
mesothelin family proteins, we noted in the current 
meta-analysis that the overall diagnostic measures includ- 
ing sensitivity, specificity, PLR, NLR, DOR and AUC of 
serum MPF were better than those of serum mesothelin. 
MPF therefore had a superior diagnostic accuracy than 
mesothelin for MPM. We also noted that the diagnostic 
performance of serum SMRP for discriminating MPM 
from healthy control subjects was the best (although not 
as good as expected) , followed by that for discriminating 



Table 5 Comparisons of diagnostic accuracy of mesothelin in pleural fluid for differentiation of MPM from different control 
subpopulations 






MPM vs other cancers 


MPM vs benign diseases 


Studies (reference numbers) 


23, 34, 36, 41, 42, 48 


36, 41 , 42, 48 


Sensitivity (95% CI) 


0.75 (0.69 to 0.80) 


0.75 (0.67 to 0.82) 


Heterogeneity* (p value) 


1 .36 (0.929) 


1 .08 (0.783) 


Specificity (95% CI) 


0.76 (0.71 to 0.82) 


0.87 (0.80 to 0.93) 


Heterogeneity (p value) 


4.88 (0.430) 


6.74 (0.081) 


PLR (95% CI) 


2.95 (2.32 to 3.75) 


4.74 (2.30 to 9.76) 


Heterogeneity (p value) 


4.83 (0.437) 


7.01 (0.071) 


NLR (95% CI) 


0.34 (0.27 to 0.43) 


0.30 (0.22 to 0.40) 


Heterogeneity (p value) 


1 .94 (0.857) 


1.83 (0.608) 


DOR (95% CI) 


8.96 (5.78 to 13.89) 


16.87 (6.79 to 41 .92) 


Heterogeneity (p value) 


3.34 (0.648) 


5.26 (0.154) 


AUC (SEM) 


0.809 (0.025) 


0.818 (0.050) 



*Q value. 

AUC, area under curve; DOR, diagnostic OR; MPM, malignant pleural mesothelioma; NLR, negative likelihood ratio; PLR, positive likelihood 
ratio. 



Cui A, Jin X-G, Zhai K, era/. BMJ Open 2014;4:e004145. doi:1 0.1 136/bmjopen-201 3-0041 45 



7 



Open Access 



6 



MPM from patients with other cancers or from 
asbestos-exposed people. In addition, the overall diag- 
nostic accuracy of PF SMRP for differentiating MPM 
from other cancers was similar to that of differentiating 
MPM from benign pleural effusions. 

Our meta-analysis had several limitations. First, exclu- 
sion of conference abstracts, letters to the editors and 
non-English language studies may have led to publica- 
tion bias. Indeed, we observed a publication bias for 
both serum and PF SMRP studies. Publication bias may 
also be introduced by inflation of diagnostic accuracy 
estimates since studies that report positive results are 
more likely to be accepted for publication. Second, 
pathological types of MPM were not specified in three 
studies, 35 42 and the epithelioid subtype of MPM was 
the most common pathological type in all studies, 
excluding the one reported by Creaney et al. 25 In total, 
69.9% (982/1404) of MPM were epithelioid subtype 
(range 29.9-100%). Analysis in terms of histological type 
has shown that SMRP levels are significantly higher in 
epithelioid subtype MPM than in other types. 21 23 29 
This could partly explain the rather low sensitivity of 
SMRPs in MPM diagnosis. Third, control populations 
were very heterogeneous from one study to another and 
various cut-off points were used for distinguishing 
between MPM and controls, other cancers or benign 
respiratory diseases, according to the best combination 
of sensitivity and specificity. These issues regarding 
accuracy of diagnosis could also lead to biased results. 

It should be mentioned that, since our previous 
meta-analysis was published, 11 the use of SMRPs in clin- 
ical practice has moved forward significantly. 10 It has 
been recognised that SMRPs are diagnostic markers and 
also serve as markers of the disease course and response 
to treatment. 56 57 The application of SMRPs in clinical 
practice in the near future may therefore be in monitor- 
ing the response to treatment rather than in guiding 
diagnostic decisions and risk assessment of 
asbestos-exposed populations. 

In conclusion, the current evidence supports the view 
that SMRPs in both serum and PF are helpful markers for 
diagnosing MPM. The overall diagnostic performance of 
SMRPs in serum and PF was similar, and serum MPF had 
superior diagnostic accuracy compared with serum 
mesothelin. The negative results of SMRP determinations 
were not sufficient to exclude non-MPM whereas the posi- 
tive test results might be helpful in confirming MPM. 
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